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Abstract 

For  more  than  a  dozen  years  most  components  of  the  Department  of  Defense  (DoD)  have  been 
exploring  the  means  for  incorporating  effects  based  thinking  into  their  planning,  execution,  and 
assessment  activities  of  the  command  and  control  process.  Over  the  same  period  of  time  effects 
based  tools  that  support  the  development  of  analytical  models  relating  actions  to  effects  have 
been  developed  by  the  research  and  development  (R&D)  community.  Researchers  from  George 
Mason  University  (GMU)  have  used  these  tools  in  several  war  games  and  have  evolved  new 
modeling  techniques  and  uses  for  these  tools.  This  paper  describes  how  the  models  were 
developed  and  used  in  these  war  games.  Furthermore,  it  suggests  how  the  modeling  techniques 
could  be  better  incorporated  into  the  effects-based  operations  (EBO)  planning  and  execution 
processes  in  the  future.  The  authors  believe  that  the  lessons  learned  from  the  war  gaming 
experience  can  provide  guidance  to  the  further  development  of  tools  to  support  effects  based 
operations,  the  procedures  for  incorporating  these  effects-based  concepts  into  the  command  and 
control  processes,  and  provide  examples  to  support  the  education  of  the  forces  in  effects  based 
thinking. 

1.  Introduction 

Institutionalizing  EBO  is  a  complex  undertaking  that  requires  the  development  of  new 
doctrine,  the  education  of  the  forces  in  the  EBO  concepts  along  with  the  development  of  a 
common  lexicon  of  terms,  the  adaptation  of  the  current  command  and  control  processes,  and  the 
development  and  use  of  tools  that  support  effects  based  analysis. 

Since  2000,  the  DoD  components  have  conducted  experiments  and  war  games  to  develop  and 
test  approaches  for  making  effects  based  operations  work  in  the  real  world  environments.  In 
most  cases,  there  were  no  tools  specifically  designed  to  support  effects  based  thinking.  A  few 
organizations  such  as  the  Air  Force  Research  Laboratory,  IF  Division  at  Rome,  NY  and  George 
Mason  University  have  developed  prototype  tools  for  relating  actions  to  effects  in  a  quantitative 
manner  to  support  the  development  of  models  of  situations  that  can  be  used  to  perform  trade-off 
analysis  in  course  of  action  development  and  selection.  GMU  has  had  the  opportunity  to  use  the 
tool  it  developed,  called  CAESAR  II/EB,  in  the  Navy  Title  X  war  games.  Global  2000  and  2001, 
and  the  Joint  Forces  Command  (JFCOM)  J-9  Joint  Experiment,  Millennium  Challenge  2002 
(MC-02). 


'  This  work  was  supported  by  the  Office  of  Naval  Research  under  grant  No.  N00014-00-1-0267  and  by  the  Air 
Force  Office  of  Scientific  Research  under  grant  No.  F49620-02-1-0332 


Over  the  eourse  of  the  war  game  participation,  the  GMU  team  explored  different  uses  of  the 
CAESAR  II/EB  tool  in  support  of  various  decision  processes  within  the  command  and  control 
organization.  GMU  worked  with  Blue’s  Red  Cell  and  the  Information  Operations  (10)  planning 
cell  during  much  of  these  activities.  As  experience  was  gained  in  using  the  tool,  the  team  was 
challenged  to  see  if  the  tool  could  be  used  to  answer  an  expanding  set  of  questions.  As  a  result 
the  GMU  team  expanded  its  repertoire  of  uses  for  the  CAESAR  II/EB  tool  beyond  the  manner 
for  which  it  had  been  originally  designed.  In  this  paper  we  describe  four  of  these  techniques. 
Each  is  presented  as  a  short  case  study.  Section  2  provides  a  brief  description  of  the  CAESAR 
II/EB  modeling  and  analysis  capability.  Section  3  describes  each  technique.  Case  1  describes 
the  uses  of  the  tool  to  support  Course  of  Action  (CO A)  comparison  using  a  situation  in  which  an 
adversary  possesses  chemical  or  biological  weapons.  Case  2  describes  a  technique  for 
developing  models  to  support  indications  and  warning  of  attack  by  an  adversary  to  include  an 
estimation  of  the  time  of  such  attack.  Case  3  describe  a  new  capability  that  allows  the 
incorporation  of  evidence  from  Intelligence,  Surveillance,  and  Reconnaissance  (ISR)  sources  to 
support  the  assessment  of  progress  in  achieving  desired  effects.  Case  4  describes  how  the 
CAESAR  II/EB  tool  could  be  used  to  support  an  assessment  process  as  plan  execution  takes 
place.  We  summarize  our  observations  in  Section  4. 

2.  CAESAR  II/EB  Basics 

The  CAESAR  II/EB  tool  was  originally  designed  to  support  of  the  analysis  of  an  adversary’s 
actions  and  reactions  to  Blue  activities  so  that  COA  options  could  be  evaluated  in  a  rigorous 
manner.  It  was  inspired  by  the  need  to  support  the  development  of  10  planning  and  its 
integration  with  traditional  (non-IO)  military  operations.  We  have  describe  the  tool  in  some 
detail  in  previous  Command  and  Control  Research  and  Technology  Symposium  (CCRTS) 
papers^,  so  we  will  only  provide  a  short  summary  here. 

The  tool  incorporates  influence  nets  as  a  probabilistic  modeling  technique  and  a  discrete  event 
system  modeling  technique.  Colored  Petri  Nets  (CP  net),  to  support  the  temporal  aspects  of  COA 
evaluation.  These  two  techniques  enable  the  modeler  to  create  the  structure  of  actions,  effects, 
beliefs  and  decisions  and  the  influencing  relationships  between  them.  The  strength  of  the 
influencing  relationships  is  also  captured.  The  influence  net  provides  a  static  equilibrium 
probabilistic  model  that  indicates  the  probability  of  effects  given  sets  of  actions.  A  mapping  has 
been  established  and  an  algorithm  has  been  encoded  for  automatically  converting  the  influence 
net  to  a  CP  net.  After  an  influence  net  is  converted  to  a  CP  Net,  temporal  analysis  can  be 
conducted  that  provides  the  probability  of  effects  over  time  given  a  timed  sequence  of  actions. 
This  tool  was  designed  to  develop  and  assess  COAs  at  the  operational  and  strategic  level. 

The  influence  net  provides  an  environment  for  modeling  of  the  causal  relationships  between 
actions  by  our  forces  (Blue)  and  effects  on  the  adversary  (Red).  It  uses  a  graphical  representation 
comprised  of  nodes  that  represent  actions  or  effects  and  causal  relationships  between  the  nodes. 

In  addition  to  the  network  structure  of  the  model,  estimates  of  the  “strength”  of  the  causal 
relationships  is  added  and  enables  an  underlying  probabilistic  model  base  on  Bayesian 
mathematics  to  be  used  for  analysis.  The  construct  shown  in  Figure  1  is  used.  Starting  from  the 
set  of  desired  and  undesirable  effects  that  reflect  the  goals  of  the  mission,  analysts  work 


^  Wagenhals,  L.  W.  and  Levis,  A.  H.  (2002).  “Modeling  support  of  Effects  Based  Operations  in  War  Games,”  7* 
Command  and  Control  Research  and  Development  Symposium,  Naval  Post  Graduate  School,  Monterey  Ca,  June 
2002. 
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backwards  to  relate  the  effects  to  actions  that  are  under  our  control.  Once  the  Influence  net  has 
been  completed,  it  can  be  used  to  evaluate  the  impact  of  actions  on  the  effects  (decisions)  of 
interest  using  its 
underlying  Bayesian 
mathematics. 

Once  the  analysis 
of  the  Influence  net 
has  been  completed 
and  the  actionable 
events  for  the  COA 
have  been  selected, 
planners  assess  the 
availability  of 
resources  to  carry  out 
the  tasks  that  will 
result  in  the 
occurrence  of  the 
actionable  events. 


Set  of  Blue’s 
potential 
actionable 
events  that 
may 

influence  the 
set  of  effects 
on  RED 


Set  of 

Desired  and 
Undesirable 
Effects 


Figure  1.  Modeling  Actions  and  Effects 


The  resultant  plan  will  indicate  when  each  actionable  event  will  occur.  Clearly,  it  is  not  only  the 
selection  of  the  set  of  actions  that  will  lead  to  achieving  the  overall  desired  effects  while  not 
causing  the  undesired  ones  that  is  important.  The  timing  of  those  actions  is  critical  to  achieving 
the  desired  outcomes. 


An  algorithm  has  been  implemented^  that  converts  an  influence  net  into  a  discrete  event 
dynamical  system  model.  The  particular  mathematical  model  used  is  that  of  CP  Nets  and  their 
software  implementation  in  Design/CPN"^.  The  nodes  in  the  Influence  net  become  transitions  in 
the  CP  Net  and  the  places  hold  tokens  that  carry  the  marginal  probabilities.  Since  the  Influence 
net  does  not  contain  temporal  information,  it  must  be  provided  as  an  input  to  the  CP  Net. 


Figure  2  shows  the  combination  of  models  and  results  produced  by  the  CAESAR  II/EB  tool. 
An  Influence  net  model  for  a  given  situation  is  shown  in  the  upper  left  of  Figure  2.  Each  node 
represents  an  action,  event,  belief,  or  decision.  A  declarative  sentence  in  the  form  of  a 
proposition  is  used  to  express  the  meaning  of  each  node.  The  directed  arcs  between  two  nodes 
mean  that  there  is  an  influencing  or  causal  relation  between  those  nodes.  The  truth  or  falsity  of 
the  parent  node  can  affect  the  truth  or  falsity  of  the  child  node.  The  Influence  net  has  been 
arranged  with  potential  Blue  actions  on  the  left  and  the  key  Red  decisions  on  the  right.  This  is  to 
indicate  visually  that  the  effects  of  the  actions  are  expected  to  propagate  to  intermediate  effects 
over  time  until  their  impact  reaches  the  key  decisions.  This  captures  the  cascading  and 
accumulation  of  effects.  There  are  six  actionable  events  on  the  left  side  of  the  Influence  net. 
These  are  candidate  actions  (or  results  of  actions)  that  can  comprise  a  COA  that  can  impact  the 
three  Red  decisions  of  interest. 


^  Wagenhals,  L.  W.,  Shin,  L,  and  Levis,  A.  H.  (1998).  “Creating  Executable  Models  of  Influence  Nets  with  Coloured 
Petri  Nets,”  Int.  J.  STTT,  Springer- Verlag,  Vol.  1998,  No.  2,  pp.  168-181. 

Jensen  K.  (1997).  Coloured  Petri  Nets:  Basic  Concepts,  Analysis  Methods  and  Practical  Use.  Volumes  1,  2,  and  3. 
Basic  Concepts.  Monographs  in  Theoretical  Computer  Science,  Springer- Verlag,  Berlin,  Germany. 
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Figure  2.  CAEAR II/EB  Products 

Once  the  analysis  of  the  Influence  net  has  been  completed  and  the  actionable  events  for  the 
COA  have  been  selected,  the  Influence  net  is  automatically  converted  to  an  executable  model 
(CP  net)  so  that  a  temporal  analysis  of  the  COA  can  be  performed.  Using  the  executable  model, 
the  analyst  is  able  to  generate  the  probability  profiles  that  show  the  marginal  probability  for  any 
node  in  the  net  as  a  function  of  time.  These  profiles  can  indicate  how  long  it  will  take  for  the 
effects  of  the  actionable  events  to  affect  various  nodes  in  the  Influence  net.  The  analyst  will 
most  likely  concentrate  on  the  probability  profiles  of  the  key  decision  nodes,  the  nodes  with  no 
children.  The  probability  profiles  shown  in  Figure  2  were  generated  for  the  COA  proposed  by 
the  planners.  The  annotations  have  been  added  to  indicate  the  three  separate  probability  profiles. 
Different  timing  of  the  actions  can  alter  the  probability  profiles,  some  will  be  more  desirable  than 
others.  Some  may  be  unacceptable,  so  the  planners  will  try  to  adjust  they  scheduling  of  actions. 

3.  Case  Studies 

In  this  section  we  describe  four  techniques  for  using  the  capabilities  of  the  CAESAR  II/EB 
tool  to  support  effects  based  operations.  Each  case  study  is  described  using  a  fictitious  scenario 
that  has  been  created  by  the  authors  to  highlight  the  capability  of  the  technique.  They  are  not 
exact  examples  form  any  of  the  war  games. 

S.l.  Case  1,  Introducing  Forces  with  Chem/Bio  Threat 

We  introduce  this  case  to  demonstrate  the  COA  option  generation  and  comparison  capability 
and  techniques  of  the  CAESAR  II/EB  tool.  We  use  a  scenario  in  which  a  rebel  force  occupies  a 
territory,  perhaps  an  island,  and  potentially  possesses  chemical  or  biological  weapons.  The  Blue 
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objective  is  to  land  forces  in  the  territory  to  cause  the  rebels  to  either  surrender  or  be  captured. 
The  rebels  have  a  leader  who  can  authorize  the  use  of  the  chemical  weapons.  This  leader 
believes  that  he  can  set  conditions  that  will  favor  his  long  term  cause.  He  believes  that  if  he 
either  threatens  or  actually  causes  unacceptable  casualties  to  Blue  or  a  high  level  of  casualties  to 
the  civilian  population,  Blue  will  be  dissuaded  from  continuing  to  threaten  him  and  the  rebel 
cause.  He  has  two  ways  of  using  the  chemical  weapons.  In  the  first,  he  can  mount  them  on  short 
range  Tactical  Ballistic  Missiles  (TBMs)  to  be  fired  at  the  Blue  Forces,  but  this  may  expose  his 
TBMs  to  air  strikes.  If  he  is  unwilling  or  unable  to  use  the  TBMs,  his  rebel  forces  may  release 
the  chemical  agents  to  cause  the  casualties. 

The  Rebel  Leader  must  have  good  situational  awareness  of  the  territory  (island)  he  occupies. 
Blue  has  some  control  over  this.  The  Rebel  forces  must  be  willing  to  follow  the  Rebel  Leader’s 
direction,  including  the  possible  release  of  the  chemical  weapons  that  may  cause  casualties  not 
only  to  Blue,  but  to  the  Rebels  and  the  civilian  population.  Thus  Blue  may  be  able  to  persuade 
the  Rebel  forces  to  not  take  this  action.  Blue  plans  to  provide  humanitarian  assistance  (HA)  (and 
potentially  Disaster  Relief  (DR)  if  there  are  many  casualties)  to  the  civilians  in  the  territory  as 
soon  as  Blue  is  able. 

The  influence  net  model  that  captures  the  features  of  this  situation  is  shown  in  Figure  3.  It  has 
as  the  overall  effect  of  interest,  “There  are  Many  Causalities  on  X”  (X  is  the  territory  or  island). 
The  objective  is  to  keep  the  probability  of  this  undesired  effect  low.  On  the  left  side  of  the 
influence  net  is  a  set  of  actionable  events  that  are  the  potential  elements  of  the  COA.  These 
actions  include  Information  Operations  to  limit  Rebel  Leader’s  situational  awareness  of  Blue  and 
X,  actions  to  discredit  the  Rebel  Leader  in  the  eyes  for  the  Rebels,  offering  safe  passage  to  the 
Rebels  if  they  do  not  follow  the  Rebel  Leader,  and  the  reporting  of  the  impending  HA/DR 
intentions  and  actions  of  Blue.  The  landing  of  the  forces  is  also  an  actionable  event. 


8  Blue  10 
rafiiricts  Reb  Ldr 
®SA  ofXs 


1^  Blue  10  onX 
discredits  Reb 
®  Ldr 


1  5  Blue  forces 
disable  chem 
fflbability  onX 


Figure  3.  Influence  Net  for  Dealing  with  Chemical  Weapons 
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Five  timed  sequences  of  the  actionable  events  that  comprise  different  CO  As  were  analyzed  to 
see  the  impact  of  the  timing  on  the  probability  of  the  effects.  COA  1  was  based  on  Blue  Forces 
landing  on  X  on  day  10  followed  by  an  aggressive  10  campaign  composed  of  the  10  actions. 

The  result,  shown  in  Figure  4,  is  a  3  day  window  when  the  probability  of  casualties  due  to  the 
release  of  chemical  weapons  increases  significantly.  We  can  examine  the  “cause”  of  the 
probability  profile  by  superimposing  on  the  same  chart  the  probability  that  TBMs  are  used  and 
the  probability  the  rebels  release  the  chemical  agents  (Figure  5).  Alternate  COAs  that  adjust  the 
timing  of  the  10  actions  in  relationship  with  the  landing  and  related  probability  profiles  can  be 
used  to  assess  relative  impacts.  Some  reduced  the  window  of  vulnerability  such  as  the  profile  in 
Figure  6  that  shows  a  “better”  COA.  Figure  7  shows  the  “best”  COA  that  contains  early  use  of 
10  to  restrict  the  Rebel  Leaders  Situation  Awareness  of  X  and  10  to  discredit  the  Rebel  Leader  to 
the  Rebel  forces,  while  it  delays  the  announcement  of  the  Humanitarian  Assistance  (that  may  tip 
off  the  Rebel  Leader)  until  just  before  the  landing.  The  result  is  the  elimination  of  the  window 
of  vulnerability.  Further  analysis,  not  shown  shows  that  when  the  forces  land,  they  must  react 
quickly  to  disable  the  chemical  systems  to  minimize  the  time  they  are  available  for  release  by  the 
Rebels.  Figure  8  shows  a  composite  comparing  the  original  COA  1  with  the  “best”  COA.  Such 
a  figure  could  be  used  to  support  the  argument  of  accepting  the  “Besf  ’  COA. 
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3.2.  Case  2,  Incorporating  Evidence  from  ISR 
Indicators 

Our  second  case  is  designed  to  illustrate  how 
incorporating  evidence  from  ISR  observations 
can  enhance  assessment  of  progress  of  a  COA 
toward  achieving  overall  effects.  Incorporating 
this  capability  in  CAESAR  II/EB  required  adding 
a  backward  probability  propagation  algorithm  to 
the  existing  forward  propagation  algorithm.  The 
algorithm  has  two  variants.  An  un- timed  version 
and  a  timed  version. 

To  use  the  capability,  certain  indicator  nodes 
must  be  incorporated  into  the  model.  These  are 
nodes  that  represent  events  or  conditions  that  may 
be  observed  by  sensors.  These  indicators  must 
have  a  causal  relationship  with  at  least  one  other  node  in  the  influence  net  model.  For  example, 
there  may  be  a  condition  that  should  occur  if  the  COA  is  working  toward  achieving  an  effect,  but 
that  condition  may  be  difficult  or  impossible  to  observer  directly.  However,  if  that  unobservable 
condition  does  occur  (or  does  not  occur)  in  may  in  turn  cause  (with  some  probability)  another 
event  that  could  be  observed.  If  the  we  observe  this  event  or  condition,  then  we  can  infer  the 
state  of  the  unobserved  event  that  caused  it.  In  general,  if  such  evidence  is  incorporated  in  the 
model,  it  will  reduce  the  uncertainty  in  the  results. 

We  illustrate  this  capability  by  modifying  our  example  of  the  Rebel  Forces  on  X.  A  more 
detailed  influence  net  of  the  situation  has  been  created  as  shown  in  Figure  9.  The  overall  desired 
effect  is  that  the  Rebel  Forces  no  longer  occupy  X  militarily.  The  model  has  15  actionable 
events  that  could  comprise  a  COA  to  achieve  the  effect.  Several  actions  are  non-lethal  including 
both  10  actions  and  maneuver  of  Blue  force  capability.  Assume  that  initially,  non-lethal  and 
lower  risk  actions  are  taken  in  the  following  manner.  On  day  one.  Blue  begins  an  10  campaign  to 
encourage  individual  members  of  the  Rebel  Forces  to  leave  X,  and  at  the  same  time  the  10 
campaign  discredits  the  Rebel  Leader’s  cause.  On  day  two.  Blue  10  sends  messages  to  the 
Rebels  indicating  that  they  will  not  have  any  reinforcements  if  they  engage  Blue.  A  little  later, 
Blue  offers  safe  passage  to  any  Rebels  willing  to  leave  X.  On  day  three.  Blue  issues  a  demarche 
to  the  Rebels  that  includes  terms  for  surrender. 

A  number  of  indicators  are  included  in  the  model.  These  include  the  Rebel  Forces  leaving 
their  tactical  positions  and  the  Rebel  Forces  abandoning  their  arms.  The  former  is  an  indication 
that  the  rebel  forces  have  accepted  the  conditions  for  surrender,  but  have  not  yet  surrendered. 
Suppose  that  ISR  observes  the  first  indicator  on  day  5.  In  Figure  9,  we  have  pointed  out  the  node 
to  which  the  evidence  has  been  added.  In  the  tool,  the  node  becomes  green  in  color  which 
indicates  that  this  evidence  has  been  included  in  the  model.  When  this  evidence  is  incorporated 
into  the  model,  the  probability  profile  changes  significantly  (Figure  10).  Prior  to  inputting  the 
evidence  only  a  portion  of  the  COA  had  been  executed.  The  probability  profile  showed  progress 
was  being  made  toward  achieving  the  effect  of  the  Rebel  no  longer  being  in  control  of  X 
reaching  a  maximum  probability  of  45%  by  day  7.  When  the  evidence  is  included  in  the  model, 
the  probability  jumps  to  80%  by  day  7.  This  means  that  there  is  much  stronger  indications  that 
the  COA  is  working.  Indeed,  it  may  be  possible  to  alter  the  COA  and  not  conduct  some  of  the 
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actions  that  were  being  eontemplated.  Addition  evidence  could  re-enforce  or  eontradiet  this 
judgement.  In  any  case,  having  the  ability  to  add  evidence  to  the  model  ean  enhance  its  support 
to  the  assessment  of  progress. 
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3.3.  Case  3,  Indications  and  Warning  (of 
Impending  Attack) 

In  many  situations  there  may  be  a  time 
when  Blue  Forees  are  maneuvering  or 
massing  in  preparation  of  action  or  to 
present  the  threat  of  aetion  to  an  adversary. 
One  of  the  eoncerns  of  the  Blue  Forces  may 
be  a  surprise  attaek  by  the  adversary.  This 
is  partieularly  true  if  the  Adversary  has 
TBMs. 
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Figure  10.  Probability  Profde  Comparison 


We  postulate  that  the  CAESAR  II/EB 
type  of  tool  may  be  useful  in  providing 
warning  to  Blue  forces  of  such  attack.  The 
idea  is  straight  forward.  We  build  an 
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influence  net  that  links  indicators  to  the  an  attack  event.  The  temporal  analysis  capability  then 
provides  the  probability  profde  of  an  attack  given  we  observe  certain  indicators  of  that  attack. 

We  use  probability  that  Red  will  attack  (with  system  Y)  as  the  effect  node  in  the  influence  net. 
We  then  consider  the  functions  and  systems  that  Red  must  activate  to  launch  the  attack.  In  short, 
observing  certain  indicators  means  that  the  set  of  functions  necessary  to  cause  the  attack  has 
occurred  (with  some  probability).  Some  of  these  functions  may  not  be  directly  observable.  We 
then  work  backward  to  find  indicators  of  those  actions.  In  a  sense  we  have  reversed  the  causal 
relationship.  If  the  function  occurred,  it  will  cause  an  indicator  to  occur.  Our  model  says  that  if 
we  observe  the  indicator,  we  can  say  with  certain  conditional  probabilities  that  the  causing 
function  has  occurred.  Time  delay  information  is  added  to  the  executable  model  in  the  same 
fashion  as  we  have  done  for  the  traditional  models.  When  we  have  indicators  that  are  observable 
we  can  task  ISR  assets  to  look  for  the 
indicators.  If  and  when  the  ISR  assets  observe 
and  report  the  indictors,  the  information  is 
applied  to  the  CAESAR  II/EB  model.  The 
resultant  probability  profiles  become  the 
indication  of  the  likelihood  of  attack  and  also 
provide  an  estimate  of  when  the  attack  may 
occur. 

To  illustrate  the  concept.  Figure  1 1  shows  an 
influence  net  model  for  an  adversary  that  has 
TBMs  that  might  be  used  to  attack  Blue.  This 
three  layer  model  has  the  indicators  on  the  left, 
implications  of  those  indicators  in  the  middle, 
and  the  effect  node  for  attack  on  the  right. 

Note  that  there  are  19  indicators.  Figures  12, 

13,  and  14  show  how  the  probability  profile 
changes  as  different  indicators  are  observed.  In 
a  typical  scenario,  if  Red  was  getting  ready  to 
attack,  ISR  may  observe  several  indicators  over 
time.  As  more  indications  are  detected,  the  Figure  11.  Influence  Net  for  I&W 

probability  of  attack  increases  allowing  Blue  to 
get  ready,  increase  its  defensive  posture,  etc. 

In  the  example,  seven  indications  are  detected  over  the  time  period  2  to  10  as  shown  in  Figure 
12.  This  combination  of  indicators  causes  a  modest  increase  in  the  likelihood  of  attack.  Figure 
13  shows  that  when  indicator  2  is  observed  at  time  12,  the  cumulative  effect  of  the  previous 
indicators  when  combined  with  this  new  indicator  cause  a  more  significant  jump  in  the 
probability  of  attack  at  time  18.  Figure  14  shows  that  when  indicator  number  1  is  observed  at 
time  13,  when  the  previous  indicators  are  taken  into  account,  this  causes  the  probability  of  attack 
to  jump  to  90%  at  time  17  (four  time  units  from  the  observation  of  indicator  1).  While  not 
contained  in  this  example,  there  could  be  counter  indicators  to  attack  included.  Such  indicators 
would  show  that  the  adversary  is  reducing  his  attack  posture. 

An  interesting  observation  is  that  it  is  not  the  number  of  indications  that  determines  the 
probability  of  attack,  but  rather  the  accumulation  of  indications  over  time.  Some  indicators  have 
stronger  weights  then  others  in  their  contribution  to  the  overall  effect.  As  with  all  CAESAR 
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Figure  12.  Early  Indications  Figure  13.  New  Indicator  Figure  14.  Critical  Indicator 

II/EB  based  models,  different  timed  combinations  of  indications  will  result  in  different 
probability  profdes. 


3.4.  Case  4,  EBO  Model  Driven  Assessment 

Our  last  case  is  motivated  by  the  need  for  commanders  and  their  staff  to  be  able  to  assess  the 
progress  that  is  being  made  across  levels  of  command  for  several  desired  effects.  In  many  cases, 
this  assessment  is  part  science  and  part  art.  In  general,  military  planners  rely  on  Measures  of 
Performance  (MOPs)  and  Measures  of  Effectiveness  (MOEs)  for  these  assessments.  The  MOPs 
usually  are  associated  with  traditional  Bomb  Damage  Assessments  (e.g.  was  the  building  hit  with 
the  correct  ordinance  at  the  correct  time?).  MOEs  tend  to  be  more  related  to  higher  level 
objectives  or  the  expected  result  of  cascading  effects  from  tactical  actions.  The  objective  is  to 
assess  MOPs  and  MOEs  to  come  to  a  consensus  about  the  progress  that  is  being  made  toward  the 
objectives  and  how  long  it  will  take  to  achieve  those  objectives. 

With  an  effects  based  approach,  commanders  are  looking  for  assessments  of  how  the  COA  is 
doing  toward  achieving  the  desired  overall  effects.  Currently,  this  is  done  with  the  same 
combination  of  evidence  and  indications  of  MOPs  and  MOEs,  and  a  subjective  judgment  as  to 
how  long  it  will  take  to  achieve  the  desired  effect. 

Given  that  effects-based  models  have  been  created  for  the  effects  that  are  to  be  achieved  and 
these  models  have  been  used  to  select  a  COA,  it  seems  quite  straight  forward  to  use  these  models 
to  provide  the  assessment  picture.  If  each  desired  effect  has  such  a  model,  the  probability  profile 
generated  by  that  model  can  be  used  to  assess  both  the  trend  toward  the  effect  and  how  long  it 
may  take  before  the  effect  is  achieved.  By  applying  threshold  levels  for  measures  of  goodness  to 
the  probabilities  of  each  effect,  the  probability  profile  can  be  converted  into  an  easy-to- visualize 
graphical  picture.  Figure  15  illustrates  the  concept.  The  top  of  Figure  15  shows  a  notional 
Effects-Based  Assessment  Matrix.  The  left-hand  column  lists  a  set  of  primary  effects  of  concern 
to  the  organization  using  the  matrix.  The  second  column  provides  a  graphical  depiction  of  the 
trend,  that  is,  a  summary  how  the  COA  is  progressing.  Up  arrows  mean  that  probability  of 
achieving  the  effect  is  increasing.  A  horizontal  arrow  means  the  probability  is  not  changing  by 
much.  A  downward  arrow  would  mean  the  situation  is  degrading;  an  indication  that  the  COA 
should  be  re-examined.  The  remaining  columns  reflect  a  time  line.  Each  column  represents  a 
time  period,  for  example  hours,  days,  weeks,  etc.  The  symbols  in  each  to  these  columns  reflects 
the  assessment  of  the  probability  of  achieving  the  effect  in  the  time  interval.  The  color  of  the 
symbol,  red,  yellow,  or  green,  indicates  that  the  probability,  low,  medium,  or  high,  respectively, 
of  the  effect  being  achieved  in  that  time  interval.  There  are  two  types  of  symbols,  circles  or  “Xs” 
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Figure  15.  Creating  an  Effects  Based  Assessment  Matrix  Using  CAESAR  II/EB  Models 

The  circle,  in  this  example,  represents  a  previous  assessment.  The  “X”  indicates  the  current  and 
future  assessments.  As  shown  in  the  row  for  the  second  effect  in  the  eight  time  period,  it  is 
possible  also  to  incorporate  an  indication  that  the  trend  is  reversing  during  this  time  period.  In 
this  case  a  downward  arrow  has  been  added.  Again,  this  may  be  a  flag  for  examination  of  the 
COA. 

The  overall  concept  is  that  the  assessments  could  be  driven  quantitatively  by  the  probability 
profile  of  an  underlying  CAESAR  II/EB  model  for  the  effect.  Three  notional  probability  profiles 
provided  by  the  CAESAR  II/EB  tool  are  shown  below  the  Matrix.  Each  probability  profile  has 
been  annotated  with  the  time  interval  associated  with  the  columns  in  the  Matrix.  In  addition, 
threshold  levels  for  determining  the  assessment  value  have  been  established  for  each  effect. 

Note  that  the  thresholds  do  not  have  to  be  the  same  for  every  effect.  Some  effects  may  have 
lower  thresholds  than  others. 

We  envision  this  technique  being  used  in  a  command  and  control  system  that  has  multiple 
models  supporting  the  effects  based  process.  At  each  echelon  models  supporting  the  effects  of 
concern  at  that  echelon  are  developed  and  maintained.  The  models  are  used  not  only  to  support 
COA  analysis  and  selection,  but  also  to  drive  the  Assessment  Matrix  that  the  commander  and 
staff  can  access.  The  Assessment  Matrix  functions  as  a  quick  look  visualization  of  the  overall 
COA  and  its  past,  current,  and  projected  execution  over  time.  The  focus  is  on  the  desired  effects. 
The  command  and  staff  can  focus  on  those  effects  and  the  CO  As  designed  to  achieve  them.  It  is 
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easy  to  see  the  COAs  that  may  be  not  performing  to  expectations  as  well  as  those  that  are 
working  better  than  expected.  If  the  underlying  effects-based  models  have  the  indicators  as  was 
shown  in  Case  2,  the  arrival  of  an  indicator  observation  could  cause  a  significant  change  in  the 
Assessment  of  the  effect.  This  could  be  immediately  reflected  in  a  change  to  the  Assessment 
Matrix. 

4.  Summary 

Over  the  past  decade,  both  the  R&D  and  the  operational  communities  have  been  evolving  and 
refining  the  concept  of  effects  based  operations.  On  the  R&D  side,  tools  to  support  an  effects 
based  analysis  of  COAs  has  been  developed.  CAESAR  II/EB  as  one  instantiation  of  this  type  of 
tool  has  been  used  in  operationally  realistic  war  games  and  experiments  in  collaboration  with  the 
operational  community.  This  experience  has  enable  the  researches  to  better  understand  the  needs 
of  the  operator  and  to  expand  the  researcher’s  repertoire  of  modeling  types  and  techniques  to 
provide  support  to  different  classes  of  problems. 

In  this  paper  we  have  presented  four  variants  of  basic  effects  based  models  that  were  created 
with  the  CAESAR  II/EB  tool.  As  in  many  cases,  a  good  tool  has  multiple  uses.  We  have 
discovered  several  through  our  war  game  inspired  experimentation  with  the  tool.  The  uses  we 
have  described  in  this  paper  span  the  spectrum  from  indications  and  warning,  COA  development 
and  selection,  the  inclusion  of  evidence  from  ISR  to  reduce  uncertainty  in  the  COA  model,  to 
overall  assessment  of  multiple  effects.  We  think  that  the  tool  or  its  successor  can  provide  a 
unifying  framework  for  effects  based  operations  across  echelons  and  across  the  process  of  COA 
selection,  planning,  execution  and  assessment.  Perhaps  the  largest  challenge  ahead  is  to  develop 
a  cadre  of  analysts  within  the  operational  community  who  can  quickly  create  these  types  of 
models.  Members  of  that  cadre  should  be  made  available  at  multiple  echelons  of  the  command 
and  control  structure.  These  cadre  could  continuously  coordinate  the  develop  and  maintenance 
of  there  models  as  they  support  the  planning,  execution  and  assessment  process.  As  we  continue 
to  increase  our  understanding  of  the  use  of  this  basic  model  and  the  techniques  and  procedures 
that  support  those  uses,  we  should  begin  to  be  able  to  better  support  the  operators  as  they  conduct 
effects-based  operations. 
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OVERVIEW 


•  Purpose:  to  describe  new  approaches  for  using  an  effects  based 
modeling  tool  (CAESAR  ll/EB)  for  supporting  Effects  Based 
Operations 

•  CAESAR  ll/EB  (Effects  Based)  Basics 

-  Process 

-  Influence  nets 

-  Colored  Petri  Nets 

•  Four  modeling  techniques  explored 

-  A  model  of  Chem/Bio  attack 

-  A  model  to  test  the  backward  propagation  capability 

-  An  indications  and  warning  model 

-  Model  support  to  assessment 

•  Lessons  and  conclusions  being  evaluated 

•  Future  Directions  and  Conclusions 
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PROBLEM  STATEMENT 


•  In  order  to  carry  out  effects-based  operations,  we  need: 

-  To  identify  desired  effects 

-  To  identify  actionabie  events  and  relate  them  to  the  effects 
(establish  a  cause-effect  reiationship) 

-  To  develop  strategies  that  maximize  the  probability  of 
achieving  the  desired  affects  over  time 

-  To  be  able  to  measure  the  degree  to  which  we  are  achieving 
the  desired  effects  as  we  execute  our  plans 


•  The  integration  of  four  key  methodologies 

-  influence  nets,  a  form  of  Bayesian  nets 

-  Coiored  Petri  Nets  (Discrete  event  dynamicai  models) 

-  Temporal  Logic 

-  Modeiing  and  Simulation 
provides  a  feasibie  approach 
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EBO  PROBLEMS 


•  EBO  Problem:  Relating  Effects  (desired  and  un-desired)  to 
Actionable  Events  through  cause-effect  relationships 

•  COA  Problem:  Selecting,  sequencing,  and  timing  actions  that  will 
achieve  the  desired  effects  and  suppress  the  un-desired  effects  in 
a  timely  manner 

•  ISR  Problem:  Determining  the  indicators  of  effects  and 
determining  what  and  when  to  look  for  those  indicators 

•  Evaluation  Problem:  Determining  metrics  by  which  MOPs  and 
MOEs  can  be  formulated  so  that  COAs  can  be  compared 

•  Execution  Assessment  Problem:  As  plans  that  implement 
selected  COAs  unfold  and  ISR  provides  status  of  indicators, 
calculate  the  degree  of  success  and  determine  if  changes  should 
be  made  to  COAs 
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TECHNICAL  APPROACH 


•  CAESAR  ll/EB  is  a  research  tool  for  developing  and  evaluating  Courses 
of  Action  (COAs)  by  creating  dynamic  models  of  situations 

-  It  is  based  on  the  integration  of  two  modeling  formalisms 

•  Influence  nets,  a  form  of  Bayesian  networks 

•  Colored  Petri  Nets  (Discrete  event  dynamical  models) 

-  It  allows  evaluation  of  sets  of  actions  and  how  they  impact  desired 
effects  and  undesired  consequences 

-  It  provides  visualization  of  the  impact  of  the  timing  and 
synchronization  of  actions  on  outcomes 

•  How  to  incorporate  this  type  of  tool  in  existing  C2  processes  to  support 
EBO  is  an  active  area  of  research  being  address  by  experimentation  in 
war  games 
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INFLUENCE  NET  MODELS 
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STATIC  ANALYSIS 
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CASE  STUDY  1:  CHEMICAL  WMD 


•  Scenario 

-  Rebel  force  occupy  a  territory,  may  possess  WMD 

-  Blue  mission  is  to  land  forces  and  cause  rebels  to  surrender 

-  Rebel  leader  may  authorize  the  use  of  WMD 

•  Believes  he  can  cause  high  blue  casualties 

•  May  be  willing  to  cause  many  civilian  casualties 

•  Model  assumptions 

-  If  chemical  weapons  are  set  off,  the  potential  for  many  civilian  and 
military  casualties  is  high 

-  Two  ways  for  chemical  discharge:  TBM  with  Chem  launch  by  Rebels 
and  release  of  Chem  agents  by  Rebel  forces  on  islands 

•  Rebel  leader  must  be  aware  of  the  activities  on  the  islands  including 
the  landing  of  Blue  and  decide  it  is  in  his  best  interest  to  launch 

•  Rebel  forces  could  decide  to  set  off  or  release  chem  agents  if  Blue 
force  land  on  the  island  and  if  they  have  not  decided  to  surrender. 

-  Overall  effect:  There  are  many  casualties  (need  to  keep  probability  low) 

-  Actionable  events  include  lO  and  landing  operations 
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CAESAR  ll/EB  INFLUENCE  NET 
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TEMPORAL  ANALYSIS  OF  COAs 


•  Five  timed  sequences  of  the  actionable  events  (COAs)  were  analyzed 
to  see  the  impact  of  the  timing  on  the  probability  of  the  effects. 

•  COA  1  was  based  on  the  Blue  Force  landing  taking  place  on  D+10  and 
the  lO  actions  taking  place  simultaneously  on  D+11 

-  Results  in  a  3  day  time  window  of  high  probability  of  casualties 
due  to  chem  release 

•  COA  2,  3,  and  4  delay  the  landing  until  D+  11, 12,  and  13  which 
reduces  the  time  window  of  vulnerability 

•  Best  COA  contains  the  early  use  of  10  to  restrict  the  Rebel  leader’s 
situational  awareness  and  discredit  him  with  his  forces  while  it  delays 
the  announcement  of  the  HA/DR  (that  may  tip  off  the  rebels)  until  just 
before  the  landing  at  D+13.  Result  is  elimination  of  the  window  of 
vulnerability 

•  Further  analysis  shows  that  Blue  must  react  quickly  once  it  lands  to 
disable  the  chem  systems  to  minimize  the  time  they  are  available  for 
release  by  the  Rebel  forces. 
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ANALYSIS  OF  COA  1 
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COAs  3  AND  4 

EARLY  SA  RESTRICTION;  DELAYED  LANDING 
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“BEST”  COA  (5) 

(Delay  HA/DR  Announcement,  Landing  at  D+13) 


H  Probability  Profile  for  COA4 
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COMPARISON  OF  COA  1  TO  BEST 


Probability  Profile  for  COA  Comparison 


1.0 

0.9 

0.8 

0.7 

0.6 

0.5 

0.4 

0.3 

0.2 

0.1 

"ao" 


D+10 


Probability  of  Many  Casualties 


COM 


JL 


Best  COA 


2  4  6 

"1  C0A4 
“2  C0A1 


10 


D+13 


14  16  18 


D+15 


Best  COA  eliminates  window 
of  vulnerability 


GMU 


14 


George  Mason  University 


COA  5  with  Chem  Disablement 


Assuming  it  takes  24  hours 
from  the  time  Blue  lands  on 
the  island  until  the  chem  is 
disabled,  there  is  a  short 
window  of  vulnerability 
Shortening  this  time  reduces 
the  window 


GMU 


15 


George  Mason  University 


CASE  2:  Incorporating 
Evidence  from  ISR 


•  Given  that  a  plan  exists  and  it  is  being  executed: 

-  Blue  begins  to  receive  observations  from  the  battlespace 

•  Observations:  Evidence  on  pre-conceived  direct  indicators 

•  Observations:  Evidence  on  indirect  indicators 

•  What  does  this  evidence  tells  us  about  the  changing  probabilities 
of  achieving  the  desired  events? 

-  Static  view  of  the  problem 

-  Dynamic  view  of  the  problem 

•  Critical  issues: 

-  Multiple  parents  of  a  node 

-  Temporal  unfolding  (or  roll  back) 

•  Requires  a  forward  and  backward  propagation  algorithm  to  infer 
updated  probabilities  of  occurrence  of  upstream  nodes  (parents) 
and  the  times  they  occurred  and  propagates  forward  to  re¬ 
evaluate  probability  of  achieving  effects 

GMU 
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CASE  2:  Adding  Evidence 


Backward  Propagation  Test 
-  Partial  COA  executed 


9.2  CAP 
a^w  to  X 


9.Q)'ue 

sea 

(SSftrolQisolete 


Evidence  Added 
that  Rebel  Forces 
have  Abandoned 
positions 


M0E2Rebel 

•^es^ren^r 


4.4  R^others 
^  pro^de 

sPanjPIrtfor 

/s  B  2  offers 

suSder  I  B3BI<8Fo,ces|l  2  Rsbel  forces 

®.orJI|>„sto  Lj="ik"X 

1 

ToESRebeT 

fQg:esabanclfl.n 

w  JQfs  W 

1 

1.0 

0.9 

0.0 

0.7 

O.G 

0.5 

0.4 

0.3 

0.2 

0.1 


0.0 


With  Evidence 


Probability  that  Rebels 
occupy  territory 


W/0  Evidence 


10  20 

Day  2 


30  40  50 

Day  4  Day  6 


GO  70 

Day  8 


30 


GMU 


Evidence  indicates  that  COA  is  succeeding 
May  not  need  to  carryout  ail  actions  of  COA 


17 


George  Mason  University 


CASE  3:  Indications  and 
Warning  Approach 


•  Build  influence  net  model  that  relates 
indicators  to  probability  of  (red)  attack. 

•  Add  time  delay  estimates  from  time  of 
indication  to  the  time  of  (red)  attack. 

•  Position  ISR  to  look  for  indicators 

•  Indication  can  be  input  to  the  model 

-  Temporal  analysis  gives  estimate  of 
time  of  attack 
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Figure  1:  Initial  indirect  indications  occur  between  hours  2  and  10; 
probability  of  attack  increasing 

Figure  2:  New  indicator  at  time  =  12  further  increases  likelihood  of 
attack  to  50%  by  time  =  18 

Figure  3:  Criticai  indicator  at  time  =  13  warns  that  probability  of 
attack  by  time  =  17  is  high 
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CASE  4:  EBO  Model  Driven 
Assessment 


Forward  Look  is  a  key  desire  of  Commanders 

Effects  Based  Models  could  be  used  to  provide  a  visualization 
of  the  potential  progress  being  made  during  a  campaign _ 
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CONCLUSIONS 


•  Participation  in  Wargames  and  Experiments  has  provided  a  vaiuable 
opportunity  to  discover  new  uses  of  EBO  technology  in  reaiistic 
environments 

•  The  uses  we  have  described  in  this  paper  span  the  spectrum  from 
indications  and  warning,  COA  development  and  selection,  the 
inclusion  of  evidence  from  ISR  to  reduce  uncertainty  in  the  COA 
modei,  to  overaii  assessment  of  muitiple  effects. 

•  Perhaps  the  iargest  challenge  ahead  is  to  develop  a  cadre  of  analysts 
within  the  operationai  community  who  can  quickly  create  these  types 
of  models.  Members  of  that  cadre  should  be  made  available  at  multiple 
echelons  of  the  command  and  control  structure.  These  cadre  could 
continuously  coordinate  the  deveiop  and  maintenance  of  there  models 
as  they  support  the  planning,  execution  and  assessment  process. 
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